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The invention is especially concerned with the dynamic range of such cameras. 

5 TV cameras such as TV broadcast cameras, CCTV, domestic video cameras, are 
provided with various servo mechanisms to enable satisfactory video signals to be 
produced from the imaging device, usually a CCD sensor, from a wide range of scene 
Summations. The most common servo mechanism is an auto-iris, and in fact these can 
cope with a large dynamic range, particularly if a transparent plate with an attenuating 

10 region or regions in the iris plane, denoted a spotted iris, are employed. The tendency 
has however been for the dynamic range between different scene ihuminaiions (inter- 
scene) to be dealt with by electronic shuttering. This means that in scenes of lower 
Summation, the CCD or other sensor is exposed for a full field of 20 milliseconds (ins) 
but with higher illuminalion the imager is gated so as to be exposed for perhaps only 2 

1 5 microseconds (/*&) . 

Variations of illumination within a scene (iatra-scene) present more problems. In a 

i 

scene in which pan is brightly illuminated and part is in shadow, if the region of 
shadow is of interest, then, if this signal is to occupy the full dynamic range of the 
20 camera then the signals corresponding to the brightly illuminated region would greatly 
exceed the dynamic range of the camera, and therefore must either be clipped at peak 
level, Thereby discarding the detail in the bright region, or compressed, thereby greatly 
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reducing the details in the dark region. 

A multi-exposure technique has been demonstrated to overcome this probteoi (e.g. WO- 
A-94/18801). CCD sensors may he gated to take two exposures of the same scene with 
different sensitivities e.g. 100:1 ratio. For exanyle, alternate fields could be gated at 20 
ms and 200 fxs. Combining these two fields produces a compressed picture. This 
technique is used for example when broadcasting sports events in which the action moves 
between one pan of the ground in full sunlight and another part in shadow. 

A drawback however is that the vertical resolution and temporal resolution are reduced 
with this technique, 

Intra-scene dynamic ranges are of course decreased if the CCD sensor is used in 
conjunction with an image inteusifier (ICCD), since the noise level is now increased In 
this case, imaging of scenes Illuminated by starlight would be possible. Such an ICCD 
sensor has been disclosed in our patent application no. GB-A-2 318 012, in which 
coloured stripes were placed in front of the image intensifies and processing electronics 
were used, to enable a monochrome sensor to produce a colour image, 

If tte double gating technique was extended to ICCDs as well as CCDs, there would be 
limkaiians about how fast the two exposures could be alternated. For example, if it was 
decided to expose twice within a field to reduce loss of vertical resolution, this might not 
be possible because of phosphor lag in the image intensifies This is because an image 
inteksifier has a photocathode on which an image is focussed, means such as a rnicro- 
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channel plate to rnuMply the number of electrons generated at the photocathode, and an 
anode on which the electrons impinge. The anode is coated with a phosphor to generate 
an optical image which is then picked up by a CCD. There is a limitation as to how fast 
the intensity of ininjmiarion of the phosphor can change. 

The problem of double exposure with intensifiers could be solved by an arrangement of 
- two intensifiers aad abeam splitter passing, say, 90% intensity to one mtensifier and 10% 
to the other. However, the cost and bulk of the camera would then increase, and the 
intensifier receiving the greater intensity of fflummation would require replacement at 
more frequent intervals than the other. 

' The invention provides a camera comprising a sensor for receiving radiation 
representative of a scene, filter means arranged to attenuate the radiation reaching 
different spatial regions of the sensor xo different extents, and decoding means arranged 
to combine the contribaiions to the output of the sensor from the, different regions, to 
produce an output of extended dynamic range. 

The invention permits the disadvantage of reduced vertical resolution and terrporal 
resolution to be avoided without recourse to using two image intensifiers, 

The attenuating regions of the filter -are preferably arranged in stripes, preferably non- 
parallel to the lines of the sensor, preferably inclined at around 45° to the lines. 
Analogue comb filters are preferably used to decode the encoded video signal produced 



by 



thfc sensor. 
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The reference to filter means attenuating to a different extent includes total attenuation 
(opaque), zero attenuation (transparent), and any degree between opaque and transparent, 
and also includes attenuation by neutral density, by colour, or by polarisation. 

Hie invention also provides a camera comprising a sensor for receiving radiation 
representative of a scene, filter means arranged to attenuate the radiation reaching 
•different spatial regions of the sensor to different extents, and decoding means arranged 
to combine the contributions to the output of the sensor from the different regions, to 
produce an output of expanded contrast. 



Cameras constructed in accordance with the invention will now be described in detail, 
by way of example, with reference to the accompanying drawings, .in which: 



Figure 1 represents a subject it is desired to image, in which the subject has full contrast 
15 and there are no highlights; 

Figure 2 represents a scene which is actually to be imaged, wherein highlights present 
reduce the contrast on the subject to a low level; 

20 Figure 3 represents a low sensitivity image of the scene of Figure 2; 

Figure 4 represents a high sensitivity image of the scene of Figure 2; 



Figure 5 represents a combination of the images of Figures 3 and 4; 
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Figure 6 is a block diagram of the camera; 

Figure 7 represents a typical tine of encoded video signal; 

5 Figure 8 represents an optical filter bearing a stripe pattern overlying the sensor of the 
camera; 

Figure 9 shows a filler to extract the peak level of the encoded video without the 
influence of the stripes; 

10 

Figure 10 shows a filter to extract a signal representative only of the stripes from the 
encoded video signal; 

Figure 1 1 shows a circuit for demodulating the output representative of the stripe pattern; 

15 

Figure 12 is a block circuit diagram of the decode electronics to produce a compressed 
video signal; and 

Figure 13 shows a portion of the sensor of the camera showing a number of lines of the 
20 sensor on which are superimposed the image of the optical filter together with a 
representation of the brightness variation produced on the video signal by che stripe 

partem, any distortion of the ixoage intensifier being ignored. 

I 



i 
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Referring to Figures 1 to 5, the aim is to produce a high contrast image of a subject 1 
(Figure 1), when the subject is viewed in the presence of a bright light 2, which has the 
effect of reducing the contrast on the subject to a very low level. This is achieved by 
imaging the scene at two different sensitivities. Thus, a low sensitivity image (Figure 3) 
is produced, as well as a high sensitivity image (Figure 4), and the two are combined to 
produce a compressed image, which shows a full range of contrast in the subject, but 
which nevertheless shows detail in the light as welL 



In accordance with the invention, the images of different sensitivities are produced 
10 simultaneously by means of an optical filter (Figures 8 and 13) which attenuates the 
radiation reaching various spatial regions of a sensor. Thus, referring to Figure 6, the TV 
camera of the invention comprises a lens 3 arranged to image a scene onto the image 
plane of an ICCD, at which the stripes of an optical filter 4 in contact with the 1CCD, art. 
in focus. Electrical circuit 6 processes the output of the ICCD, which is a video signal 
1 5 which simultaneously contains a low sensitivity and a high sensitivity representation of 
the scene being viewed. This encoded video signal is decoded in Decode Electronics 7 
to produce a compressed image as in Figure 5. 

Referring to Figures 8 and 13, the stripes are inclined and of such an density as to 
20 attenuate the incident radiation to 1% of incident intensity. The filter is clear between the 
stripes allowing 100% of incorning radiation through- 

i • 

It will be appreciated that if the camera was imaged on a scene of uniform intensity, the 
video signal for each line would consist of an approximately sinusoidal oscillation, 
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corresponding to the pitch of the stripes 8 (Figures 8 and 13) m scan diction, with 
the envelope of the peaks of the sinusoids being level (U. the peaks having the same 
amplitude) contending to light Nomination through the transparent regions between 
the stripes 8, and the envelope of the troughs of the sinusoids also being level and 
corresponding to hghi tnmsrn™ through the stripes 8 themselves. Note that the video 
signal would have an approximately sinusoidal fluctuation, as represented in Figure 13, 
rather than the square wave shape of the optical filtering on the line of the imager, 
because of filtering in the processing circuits. 

In the imaging Of an actual scene, the envelopes of the peaks and troughs of the sinusoids 
for each line wfll not be level The envelope of the peaks of the sinusoids (A) for any 
particular hue will correspond to the variation of spatial intensity of the high sensitivity 
image of Figure 4, while the envelope of the troughs of the sinusoids (B) wfll correspond 
to the variation of spatial intensity of the low sensitivity image of Figure 3. Thus, 
referring to Figure 2 and Figure 7, for one particular line, the part of the envelope A 
denoted by A 1 , corresponds to a high sensitivity image of the subject 1 in Figure 2 ie. as 
seen through the transparent region between the stripes, whereas the part of the envelope 
A denoted by A 2 , corresponds to the image of the light as seen through the transparent 
regions- The envelope A 1 varies and contains details of the intensity of the subject, white 
the part of the envelope A 1 is level since it has been clipped and therefore does not 
contain any detail of the light source 2. This corresponds to the image of Figure 4. 

The part of the envelope B denoted B 1 corresponds to the low sensitivity view of the 

i 

image 1 seen through the stripes, and is of such a low value as to barely be above the 
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noise threshold. The part of the envelope B 2 is a low sensitivity image of the light 2 and 
corresponds to the fight imaged through the stripes 8. This does contain detail. This 
corresponds to the image of Figure 3. 

5 The encoded video signal records the envelope of die peaks A and also the depth of the 
oscillatkm (B - A). 

The decode electronics 7 is shown in more detail in Figure 12 and consists of analogue 
comb falters 9 and 10 and demodulator 11. The optical filter 4 is imaged on the CCD 
10 sensor, and Figure 13 shows, on an enlarged scale, a portion of the fflter pattern 
superimposed on four lines of a field 1^ to L it+3 of the CCD sensor, together with a 
representation of the sinusoidal variation of intensity produced on the lines of the video 
signal by the image of the optical filter. 

15 Referring to Figure 13, the attenuating stripes (B for "black") alternate with non- 
attenuating stripes (W for "while"), but there is one more of one son than the other. Such 
a situation applies in Figure 13, although of course in reality there would be many more 
pairs of attenuating and non-attenuating stripes. The reason for the extra stripe is so that 
the intensity modulation impressed on, say, line L^ f x wfll follow on continuously from 

20 that impressed on line L tt . In the example shown, the last section of Hne L n is non- 
attenuating, so the first section of line L M . 1 is atte nu a t i ng . 



The 



sensor operates in a progressive scan mode ie. lines L n , I-a+i, Ln+2> L w-3 are 



consecutive and ihere is no interlacing. 
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Tte decode ttecaomc 7 operates in following trmnner. In order to produce envelop. 
A corresponding to the brightness of the high sensitivity image but with the stnpe partem 
removed, a transversal filter such as an analogue comb filter 9 sums the signals 
corxespoBding to adjacent lines e_g. W m analogue comb filter 9. This is achieved 
by adder 12 which sums the input directly received via link 14 and received via delay 1 3 
utach corresponds to one TV line (64/vs). Referring to Figure 13, since the stripe pattern 
is in anti-phase on adjacent tines, the attenuation produced by this cancels, leaving only 
the brightness variation representative of the scene, which is reinforced since two lines 
are added. The output of comb filler 9 is thus output 2A. 

The reason why the stripe pattern intensity is in anti-phase on successive lines is that the 
stripe pattern is inclined at 45° to the lines, and successive lines are spaced by half the 
wavelength of the stnpe pattern. 



15 In order to produce an output representing the difference between the modulation 
envelopes A and B, i.e. |A-B|, a transversal filter such as the comb filler in Figure 10 
subtracts adjacent lines e g. I^ 3 , L^ 2 to remove the overall brightness level of the scene 
whilst reinforcing the sinusoidal form of the stripe intensity modulation. Adjacent lines 
are subtracted at subtracter 15 by means of direct link 17 and delay 16 corresponding to 

20 one TV line (64/^). The output of this niter is the modulation corresponding to the depth 
of modulation of the sinusoids of the stripe pattern i.e. |A - B|. This signal is 
demodulated in diode detector 11 consisting of diode 18 and RC smoothing circuit 19, 

20. 
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These two signals are combined at subtracter 21 (Figure 12). Since the output of the 
comb filter 9 is double the intensity of the scene, the resulting output from the decode 
electronic is the summation of the two envelopes A and B Le. the required compressed 
image of Figure 5. 

The sensitivity loss of having only half the sensor area fully sensitive is partly restored 
by the comb filtering benefits of noise Le. 3db for single comb filter, 4.8db for a double 
filter. 



10 Improved resolution can be obtained by the use of a third delay line 22 (delay 64/zs), 
shown dotted, the output of -which is demodulated by a demodulator similar to that shown 
inHgure 1 1 but shown symbolically by diode 23. As an example, consider the arrival of 
finely at the input of comb filter 10. At the subtractor 15, tinel^ is subtracted from 
it. The amplitude of the stripe pattern modulation is increased. At the diode 11, only 

15 positive half cycles are passed Le. the first, the third etc. At the same time, diode 23 is 
passing the positive cycles of toe difference between lines L^j and 1^, this time only the 
second, fourth etc. half cycles. Thus, signal A-B is represented with increased resolution 
by comhining signal A-B from diode detector 1 1 with signal (A-B)' from diode detector 
23 , sp that there is signal present on each half cycle. Whereas the resolution of tha low 

20 sensitivity signal A-B has a bandwidth of approximately 1.8MHz, (the stripe pattern 
having a resolution of 3.5MHz), additioa of the delayed stripe pattern (A - B)' gives a 
resolution of 3.5MHz. 
i 
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With a typical CCD array of 600 x 600 pixels, the filter may consist of 300 neutral 
density stripes alternating with transparent regions of the same width as the stripes, 
subject to there being one more or less neutral density than transparent stripe across the 
length of each line. The stripes are arranged at the image plane of the ICCD in such a 
5 way that when their shadow is cast on the CCD array, tie stripes are orientated at 45' to 
the fines of the CCD array 1^ etc. It js critical that the lines are aligned with each other 
-for the purposes of the comb filters, but manufacturing tolerances mean that the stripes 
will not be arranged at exactly 45° to the lines of the CCD, manufacturing tolerances 
might also dictate that there are slightly more or less than 300 stripes crossing the top or 
10 sides of the CCD array, and- these may also be slight uncertainties in the crystal frequency 
of the camera which is used to generate the line frequencies etc. It is for this reason that, 
during manufacture, the delay foes 13, 16 and 22 are trhnmed in order to get an exact 
one line delay of 64ms between adjacent lines, and this can be done using a oscilloscope 
on the output 21. 

15 

It wfflbe appreciated that other inclinations of the stripes Co the ICCD lines are possible, 
so long as they are not vertical, since in this case there would not be a phase difference 
between one line and the next for the stripe modulation pattern, and its effects could not 
be removed. It will merely be necessary to trim the delay lines 13, 16 and 22 so that the 
20 modulation patterns of consecutive lines is in anti-phase to each other. Also, it is not 
necessary for the stripes to alternate with equal widths of transparent areas. Other 
inarkyspace ratios are possible. Further, the stripe filter need not be positioned at the 

t 

fbcalplane of the ICCD, it may be positioned anywhere in the path of radiation onto the 
CCD sensor e.g. using relay lenses, so long as it is in focus on the image plane and may 

i 
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fact be formed directly on the CCD sensor. Further, it is not necessary for there to be 
the same number of stripes and transparent areas as there are lines of the sensor, there 
ciuldbemore or less stripes and alternating transparent regions than there are lines of the 



sensor. 



In the embodiment described, the stripes only allow through 1% of light intensity. Of 
course, different densities are possible, and even the transparent region could be replaced 
by an attenuating region of different properties. In fact, opaque stripes It. 100% 
attenuation e,g- of aluminium, could be employed. Even though these stripes allow no 
light through at all, nevertheless there is a contribution to the output of the sensor, 
lamely, due to noise ^ ~j particularly generated in the image intensificx but also in the 
CCD. This noise signal provides a black level reference which can be subtracted from 
the contribution to the output from the transparent regions, to compensate for temperature 
and noise. 

Also, it is not necessary for the stripes to be of neutral density. They could be one 
particular colour e.g. blue, which would attenuate incandescent lights which radiate a 
large amount of red light. 



20 Further, the stripes could be polarising, arranged to attenuate light of a particular 
polarisation. This could be a particular advantage in reducing reflections e.g. of light 
from a wet road surface. 



Fudlher, more rtum one set of stripes could be provided. For example, a second set of 
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different attenuating properties could be provided on die optical filter at a different angle 
ro the lines of the sensor. Indeed, further sets of lines could be provided with different 
attenuating properties. In particular, a set of opaque stripes could be arranged with a set 
of 1 % attenuating stripes. With one set of stripes, they could be inclined to the vertical 
5 of the raster as seen in Figure 13 at 22°, a second set could be arranged at -22° to the 
vertical, and a third set could be inclined at -45 ° to the vertical. 

For example, a combination of stripes of neutral density, coloured (e.g. dark blue) and 
opaque could be used. The benefit of the invention (picture compression and extended 
10 dynamic range) would be both spectrally and scene responsive. 

Further, one or more sets of stripes, provided to extend the dynamic range of the sensor 
in accordance with the invention, could be combined with coloured stripes as described 
in our earlier patent application no. 2 318 012 to produce a colour or pseudo colour 
15 output from a monochrome sensor. Indeed, two sets of coloured stripes could be 
provided; a first set of one attenuation to produce the colour output, and a second set of 
greater attenuation (the same colour but greater density) to extend the dynamic range. 
These could be set at different angles to the first set. 

20 Variations may be made on the encoding (stripe patterns) and decoding to produce die 
signals A, A - B, (A - B)'. There are benefits to be gained by using more sophisticated 

filtering hi the decode electronics block 7. For example, double delay fillers ar triple 

I 

delay filters may be used. 
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The regular pitch of the stripes gives the option of demodulation of the encoded video by 
the use of a circuit tuned to the frequency of the stripes. 



In the described enjbodiment using ICCD, the image mtensrfier used produces a 
5 distortion of only V&% at the CCD sensor. However, there are other image intensifiers 
which produce a much greater geometric distortion e.g. 10%, in which case the stripe 
pattern of Figure 13 would be distorted by the image intensrfier. Another alternative 
which would be useful ia this case, would be for the decode electronics to use a memory 
map relying on stored signals to relate the pixels of the CCD sensor to the (distorted) 
10 stripe pattern falling on the CCD sensor, for example as described in our prior patent 
application no. 2 318 012. Indeed, if a memory map was used, the attenuating regions 
of the filter could be in any arrangement desired, not necessarily a stripe pattern. 

As another alternative, it will be possible to modify the delay network to accommodate 
15 geometry distortion by providing a voltage variable delay having as its input a signal 
related to the geometric distortion of the ICCD. Non-linear tuned circuits e.g. level 
and/or frequency adaptive could be used e.g. to remove a low level stripe pattern. 

The stripes may be placed in contact with the ICCD or a relay lens may be used to project 
20 their image onto the image plane of the ICCD. 

In the embodiments referred to above, the imager is an ICCD. The ICCD sensor 
comprises as is well known a CCD array coupled e.g. by optical fibres to the phosphors 
on me output surface of an image iatensifkr. The striped pattern may be cemented to the 
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front surface of the mtensifler, possibly using a fibre optic coupling. However, the 
invention is applicable also to CCD sensor* which are not intensified. Further the 
invention is applicable to monochrome or colour sensors. However, in fact a wide 
variety of imagers may be used such as a CMOS imager, a tube such as a vidicon or 
5 orthicon, sensors active in the UV region may be used, e.g. visible near infra-red or far 
infra-red. The invention has been described in relative to progressive scanning, but is 
also applicable to interlace scan. 

Furthermore the sensor may be a non-imaging sensor e.g. for an infra-red intruder alarm. 
10 Or the invention is applicable to optically-coupled thermal cameras in which the thermal 
signal is used to vary the intensity of light on a sensor e.g. by varying the polarising angle 
in a transducer. 

The cameras described above are used for high contrast scenes where compression is 
15 desirable. Some scenes, of lesser contrast, wfll benefit from the invention as well Very 
low contrast scenes, such as "misty" viewing conditions, will not show any benefit from 
the cameras. A smatt change to the cameras described above can accommodate very low 
contrast scenes. When the subtracter 15 in Figure 12 is changed to be positive ie. an 
adder, the camera becomes an expander of contrast. Some imaging sensors have a non- 
20 linear compression response (e.g. specially fabricated CCD devices). These special 
devices could be converted to a linear response by using the expansion improvement. In 
feet, the cameras described above could be provided with a switch to enable the contrast 
expander option to be selected as desired. 
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